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(54) Backplane configuration without common switch fabric 



(57) An electronic system for networking, switching 

or computing includes a backplane^based interconnec- 
tion system (100). The system includes a backplane 
(102) with a plurality of traces coupled to slots for re- 
ceiving circuit packs (1 04a-d). The backplane traces are 
configured to form point-to-point connections (106a-0 



from one slot of the backplane to every other slot of the 

backplane. A hub circuit (110) is provided on each circuit 
pack for coupling the circuit pack to the point-to-point 
connections In the backplane. Circuit packs communi- 
cate via direct connections over the point-to-point con- 
nections or Indirectly by sending traffic through point-to- 
point connections and hub circuits. 
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Description 

RELD OF THE INVENTION 

[Oaoi] The present invention generally relates to 
largo Glectronic systems, and in particular, to a telecom- 
munications switching system configuration that does 
not require a common switch fabric board. 

BACKGROUNO OF THE INVENTION 

[0002] Large electronic systems, as used in comput- 

(ng, data networking, and tBlecommunications elements 
often use a common backplane to provide high speed 
interconnection between several circuit boards, pacl<5 
or modules that plug Into slots in the backplane. The 
backplane Is typicaiiy constructed of a multi-layer circuit 
board with conductive traces selectively routed to pro- 
vide the high-speed interconnection. Connectors are 
provided on the backplane to couple circuit boards, 
packs, or modules which are held in place using a slot- 
ted chasis. The properties of these backplanes often 
have large influence over the capacity, performancei re- 
ilabitlty, cost» and scale properties of electronic systems. 
Some backplane designs provide high capacity, while 
others provide low cost. 

[0003] Currently, there are two predominant architec- 
tures for providing backplane transport Infrastructures 
In high-speed telecommunications platfomns, the bus 
and thefabrfc. These architectures both have limitations 
preventing the creation of a truly universal platform. 
[0004] Bus-based backplanes use a large set of par- 
allel signals, where each signal typicaiiy touches each 
slot and hence each board. This interconnection 
scheme is versatile and low cost, but imposes practical 
limits of a few billion bits per second on the maximum 
system throughput and also limits rellabiiity/The total 
throughput must also be shared among all boards on 
the backplane. Buses are typically used in smaller sys- 
tems that do not process large amounts of broadband 
traffic, or In systems with severe cost constraints. In par- 
ticular, bus-based backplanes have a very low cost of 
common elements, and therefore permit low system 
costs, especially where a system is not equipped with 
all of its circuit cards or modules Initially. 
[0005] Fabric based systems use a central high- 
speed fabric or hub to switch traffic between ail modules. 
High-speed point-to-point connecD'ons (either parallel or 
seriei) are routed over a cable or backplane between 
each module and the central fabric, in a star topology. 
The central fabric cah provide the large bandwidths 
(over 1 trillion bits per second) needed to support high- 
speed computing or broadband communications. Unfor- 
tunately, because the full oenu-al fabric, with support for 
the maximum number of connections, must be installed 
before any modules can be interconnected, the cost of 
such a system is often quite high, especially for partially 
equipped systems, where the large cost of the fabric is 



only amortized over a few modules. 
[0006] Computing and telecommunications needs 
are increasing tremendously. In particular, high band- 
width systems are considered a necessity for distributed 

5 cdniputing, networking and telecommunications switch- 
ing. In light of the shortcomings of traditional bue-bassd 
backplane systems and central fabric-based systems, 
a need exists for a new paradigm in backplane-based 
systems that has the low cost of bus-based interconnect 

10 and the high capacity of central fabric-based intercon- 
nect. 

SUMMARY OF THE INVgNTIQN 

is [0007] An electronic Interconnection system in ac- 
cordance with the present Invention Includes a back- 
plane. The backplane includes a mutti-layer circuit 
board with a plurality of connectorized slots for connect- 
ing to traces routed in the backplane. Using the connec- 
torized slots, circuit packs are coupled to the baclcplane 
and traces routed therein. To facilitate communication 
among the circuit packs coupled to the backplane, a hub 
circuit Is provided on each circuit pack. In addition, point- 
to-point connections are provided from one slot in The 
backplane to each and every other slot in the backplane. 
The point-to-point connections are made using traces 
In the backplane. The hub circuits on each circuit pack 
couple to the point-to-point connections to facilitate con- 
trol and routing over the communication links formed by 
the poini-to-polnt connections. 

[0008] The point-to-point connections formed in the 
backplane can be selectively routed between the slots, 
either physically or virtually, using the hub circuit to pro- 
vide different connection topologies, capacity, and reli- 
ability. In one configuration, each slot includes a point- 
to-point connection to all other slots, creating a full 
mesh. For example, for a backplane with sixteen slots 
for circuit boards, each board has fifteen point-to-point 
connections, each terminating at a different slot. This 
configuration provides a direct point-to-point connection 
from any one circuit pack or module to another circuit 
pack or module. In addition, communication between 
circuit packs is readily facilitated by communication 
through another circuit pack, if for example, a point-to- 
point connection is faulty or unavailable. A myriad of oth- 
er configurations are contemplated, including a ring con- 
figuration, wherein adjacent slots have point-to-point 
connections and slots at opposite ends are joined via 
point-to-point connections to complete the ring. 

BRIEF DgSCRiPTION OF THE DRAWINGS 

[0009] FIG. 1 is a block diagram of a backplane-based 
Interconnection system In accordance with the present 
Invention. 

[0010] FIG. 2 is a block diagram of a circuit board tor 
use in the backplane-based interconnection system 
shown in FIG. 1. 
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[001 1 ] FIG. 3 is a block diagram of a backplane-based 
interconnection system In accordance with the present 
Invention wherein circuit boards are connected in a ring 

topology. 

[001 2] FIG. 4 is 3 block diayrsm of a bSCkplaDc-baScd 

interconnection system in accordance witli the present 
invention wherein circuft boards, are connected In a 
double star topology. 

[0013] FIG. 5 is a block diagram of a backplane based 
intofconnGction system in accordanc© with the present 
invention wherein muHiple backplanes are connected 
using extender boards. 

BRIEF DESCRIPTION OF THE PREFERBE13 
EMBODIMENTS 

[001 4] FIG. 1 Is a block diagram of a backplane Inter- 
connection system 1 00 in accordance with the present 
invention. System-.lOO Included a backplane 102 and 

several circuit boards 104a-d, Backplane 102 provides 
intercommunication between circuit boards 104a-d. !n 
particular, in accordance with the present invention, cir- 
cuit boards I04a-d each have point-to-point connec- 
tions 106a-f, which are used to route communications 
between circuit boards 104a-d. 
[0015] Backplane 102 has slots 108a-d, which pro- 
vide the Interface for circuit packs 1 04a-d to couple to 
point-to-point connections 106a-f. Slots 108a-d are 
preferably connectors. Point-to -point connections 108a- 
f are formed by conductive traces formed in the multiple 
layers of backplane 102. In tho preferred embodiment, 
the electrical properties of point-to-point connections 
I06a-f are implsnrtented in accordance with the Infini- 
Band standard from the InfiniBand Trade Association, 
5440 SW Westgat© Drive. Suite 217, Portland, OR 
97221 (www.8ysio.org). In accordance with the Infini- 
Band electrical signaling specification, point-to-point 
connections 1 06a-f are 2.5 gigabits per second bi-direc- 
tional serial links over metal iic conductors. As an alter- 
native to InfiniBand, any suitable substitute point-to- 
point link technology can be used. Most preferably, the 
traces forming point-to-point connections 106a-f are 
routed as signal pairs with the signaJ pairs routed adja- 
cent to each other on a single layer of the multi layer 
bacl<plane, or on adjacent layers using Identical conduc- 
tor geometries. Most preferably, the layers adjacent to 
the layers carrying signal pairs are power or ground (that 
Is, signal ground). 

[0016] Each of tho circuit boards 104a-d includes a 
hub circuit 110. a control/routing circuit 112 and an ap- 
plication circuit 114. Hub circuit 110 directly interfaces 
with point-to-point connections I06a-f to allow the circuit 
board to communicate over the point-to-point connec- 
tions. Control/routing circuit 112 implements the proto- 
col to control tho routing over hub circuit 110 To the point- 
to-point connections 106a-f. Application circuit 114 in- 
cludes the circuitry necessary to implement a particular 
application and Interface that application to the intercon- 



nection system 1 00. For example, application circuit 1 1 4 
may implement an access or line Interface, such as IS- 
DN or a feeder or tnjnk interface, such as T1 , T3 or 
OC12, Also, application circuit 114 may implement a 
5 processing resource, a digital signal processor or an- 
other resource. 

[0017] Although four circuits boards 104a'd are 
shown In FIG. 1 only the physical limitations of back- 
plane 1 02 and point-to-point connections 1 06a-f limitthe 
number of circuit boarcls in an interconnection system 
in accordance with the present invention. In a preferred 
embodiment, 16 slots are provided in backplane 102 
and 240 point-to-point links are provided in backplane 
102 to provide a point-to-point, fuil duplex connection 
between alt 1 6 slots in the backplane. 
[001 8] FIG. 2 Is a block diagram showing cincutt board 
104a in additional detail. Circuit board 104a includes a 
power circuit 116, hub circuit 1 1 0, control/routing circuit 
1 1 2 and application circuit 114. Power circuit 116 obtains 

20 power from backplane 102 and preferably conditions, 
convents and distributes that power to the components 
of circuit board 1 04a. Hub circuit 110, control/routing cir- 
cuit 112 end appliceftion circuit 1 1 4 implement the func- 
tions described above and further below. 

25 [001 9] iHub circuit 110 preferably includes an NxN hub 
switch 120 and a routing table 122. Hub circuit 110 
serves as a distributed fabric switch element. This is In 
contrast to a central fabric switch used in telecommuni- 
cations systems In the prior art. NxN hub switch 120cou- 

30 pies circuit board 104a to N minus one point-to-point 
connecttons In the backplane. For system 100 shown In 
FIG. 1, N equals four. NxN hub switch 120 accepts and 
routes traffic to N links. Most preferably, one of the N 
links is circuit board 104a. The other links are the point 

35 to point connections to other hub circuits on circuit 
boards in other slots. NxN hub switch 120 has N minus 
one external links to point-to-point connections in back- 
plane 1 02 and one internal link 124 coupled to control/ 
routing circuit 112. Hub circuit 110 accepts traffic from 

40 the external links and routes it to the internal link. Also, 
hub circuit 110 receives communications from circuit 
board 104a over internal link 124 and routes the com- 
munication to one or more appropriate external links. A 
further function of hub circuit 1 1 0 is to accept traffic from 

-^J one of the external links and rout© that traffic to some 
Other of the external links without ever terminating that 
traffic on circuit board 104a. Routing table 122 is pref- 
erably a memory element that stores configuration in- 
formation and other data related to the point-to-point 

50 connections coupled to hub circuit 110. 

[0020] Control/routing circuit 112 provides some con- 
trol over the communications implemented by hub cir- 
cuit 11 0 and also interfaces application circuit 1 1 4 to hub 
circuit 110. Control/routing circuit 112 preferably in- 

ss dudes a control processor 1 26 and a buffer 1 2B. Control 
processor 126 is preferably any microprocessor, mem- 
ory and necessary interface circuits. Control processor 
126 preferably implements a host adapter function that 
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provides low level control, buffering aad priority man- 
agement in an InfiniBand network. Also, control proces- 
sor 126, which may be a network processor, preferably 
provides message and packet processing functions 
used for example in IP routing, asynchrunoL's transfer 5 
mode (ATM) switching, and time slot interchange and 
protocol adaptation. Control procGssor 126 preferably 
translates and Interfaces traffic from hub circuit 110 to 
the buses used on application circuit 1 14. For example, 
application circuit 114 may include one or more serial io 
links, or busses, including an InfiniBand serial link, a PCI 
bus, the tJTOPIA bus (used for asynchronous transfer 
mods cells), and the H.1X0 bus (used for synchronous 
timeslots). Buffer 128 is preferably a large RAM that 
stores packets, messages and other payloads being is 
processed by control processor 126. 
[0021] Application circuit 1 14 varies depending upon 
the application to be implemented. To facilitate flexibility 
and modularity, application circuit 114 includes several 
connectors 1 30 for receiving circuit board modules with 20 
varying functionality. Application circuit 114 Includes an 
application processor 132, RAM 134, and peripherals 
136. Application processor 132 uses RAM 134 and pe- 
ripherals 136 to implement an application, for example, 
an access or trunk interface or a feeder interface in a 
telecommunications network. Application processor 
132 is coupled to control processor 126 over bus 138. 
The prefen-ed implementation for bus 1 38 Is a standard- 
ized bus such as PCI or a serial link such as InfiniBand. 
Other standard Interface buses 140» 1 42 are coupled to 30 
connectors 130 for application clrciilts utilizing those 
buses. Most preferably, connectors 130 are PCI mez2:a« 
nine card sockets. In addition to the other functions list- 
ed above, application processor 1 32 preferably includes 
functions for bandwidth management, call processing or 35 
a general-purpose server. 

[0022] FIG. 3 illustrates a backplane interconnection 
system 200 In accordance with the present invention. 
System 200 is similar in most respects to system 100 of 
FIG. 1 , as noted by the reuse of the same reference nu- 
merals used to designate components of system 1 oo. 
However, the point-to-point connections 1 06g-J in back- 
plane 202 are configured differently from the point-to- 
/ point connections 1 06 a-f In backplane 1 02. In particular, 

the point-to-point connections 106g-j are selectively 
routed to fonn a ring configuration. In this ring configu- 
ration adjacent circuit boards have point-to-point con- 
nections to each other. For example, circuit board 1 04b 
has polm-to-polnt connections 106g, 106h to adjacent 
circuit boards 1 04a and 1 04c. The two circuit boards at 50 
opposite ends of the system, circuit boards 104a and 
104d, are considered to be adjacent and have a point- 
to-point connection 106J between them. Although Illus- 
trated In FIG. 3 as physical point-to-point connections, 
point-to-point connections 1 06g-j are alternatively virtu- 
al connections that may, for example, be implemented 
with direct or indirect connections, such as point-to- 
point connections 1 06a-f of PIG. 1 . 
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[0023] FIG. 4 illustrates a backplane Interconnection 
system 300 In accordance with the present invention. 
System 300 is similar in most respects to system 1 00 of 
FIG. 1 , as noted by the reuse of the same reference nu- 
merals used to designate components of system 100. 
However, the point-to-point connections 1 06k-o in back- 
plane 202 are routed differently from the point-to-point 
connections 106a-f In backplane 102, In particular, the 
point-to-point connections I06k-o are selectively routed 
to form a double star configuration. In this double star 
configuration, two of circuit boards 1 04a-d are arbitrarily 
chosen to be central circuit boards. In FIG. 4, circuit 
boards 104a, 104d are used as central circuit boards. 
The circuit boards that are not central circuit boards, in 
this case circuit boards 104 b, 104o, have point-to-point 
connections 1 06k, 1 06n, 1061,1 06o to each of the cen- 
tral circuit boards, but no point-to-point connections to 
each other. The central circuit boards 104a, 1 04d have 
a polnt-to'point connection 1 06m between them. The 
point-to-point connections 106k-o may be virtual con- 
nections. An alternative to the double star configuration 
is a single star configuration, in which one circuit board 
is designated a central circuit board and every other cir- 
cuit board has a point-to-point connection to the central 
circuit board, but no point-To-point connection to the oth- 
er circuit boards. 

[0024] FIG. 5 Illustrates a configuration of two back- 
plane interconnection systems in accordance with the 
present invention. One system Is designated system 
500 and the other system is designated 500*. Both sys" 
tems 500, 500' Include circuit boards 1 04a-c and back- 
planes 1 02 as shown and discussed above with respect 
to FIG. 1. In accordance with the present Invention, sys- 
tem 500 and system 500' are coupled together for com- 
munication between the circuit boards on each system 
by extender boards 504. Extender boards 504 are cou- 
pled to backplanes 1 02 to extend the point-to-point con- 
nections in the backplanes 102. Preferably, extender 
boards 504 are passive circuit boards with traces routed 
therein to electrically extend the traces in the back- 
planes 1 02. One or more cables or connectors 506 are 
preferably used to electrically couple the systems 500, 
600' to each other. 

[0025] A myriad of systems may utilize the backplane 
interconnection system disclosed herein. One of many 
example systems is a universal gateway that provides 
conversions from one networicto another network, in a 
universal gateway implemented using a backplane in- 
torconnoction system In accordance with the invention, 
The application circuits may implement access circuits 
and digital signal processing circuits. For example, 
some application circuits may terminate access lines 
and long haul tmnks. The interfaces utilized may include 
digital subscriber line (DSL) interfaces or OC12 trunk 
interfaces or other line or trunk interfaces. The digital 
signal processing circuits may be used for compression, 
decompression, encryption and decryption. 
[0026] The present invention provides an intercon- 
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nection system that includes a backplane with connec- 
tori2ed slots and a plurality of point-to-point connections 
between the slots. The point-lo-point connections are 
controlled by hub circuits couplsd to each slot of the 
backplane. The point-to-point connections and the dis- 
tributed switching function provided by the hub circuit 
eliminate the need for a central fabric switching board. 
This advantageously reduces costs while not sacrificing 
bandwidth and capacity. 

[0027] Whereas the present Invention has been de- 
scribed with respect to specific embodiments thereof, It 
will be understood that various changes and nnodlfica- 
tions will be suggested to one skilled in the art and it Is 
Intended that the Invention encompass such changes 
and modifications as fall Within the scope of the append- 
ed claims. 



Claims 

1 . An electronic system comprising: 

a backplane including a multi-layer circuit 
board with a plurality of traces and a plurality of 
slots for coupling to the plurality of traces; 
a plurality of circuit packs coupled to the plural- 
ity of slots such that one circu'ft pack of the plu- 
rality of circuit packs is coupled to one slot of 
the plurality of slots; 

wherein each circuit pack of the plurality of cir- 
cuit packs Includes a hub circuit to provide a 
plurality of hub circuits; 

wherein one hub circuit of the plurality of hub 
circuits has a point-to-point connection to an- 
other hub circuit of the plurality of hub circuits 
to facilitate communication between a first cir- 
cuit pack with the one hub circuit and a second' 
circuit pack with the another hub circuit: and 
wherein the point-to-point connection is made 
using at least some of the plurality of traces. 

2. TVi& system of claim 1 wherein the point-to-point 
connection comprises bi-directional serial links. 

3. The system of claim 2 wherein the system compris- 
es a telecommunications switching system. 

4. The system of claim 1 wherein at least one circuit 
pack of the plurality of circuit packs includes a con- 
trol/routing circuit that implements a protocol for 
communication between the one hub circuit and the 
another hub circuit. 

5. An electronic system comprising: 

a backplane including a multi-layer circuit 
board with a plurality of traces and a plurality of 
slots for coupling to the plurality of traces; 



a plurality of circuit packs coupled to the plural- 
ity of slots such that one circuit pack of the plu- 
rality of circuit packs is coupled to one slot of 
the plurality of slots; 
^ wherein each circuit pack of the piMrality of cir- 

cuit packs includes a hub circuit to provide a 
plurality of hub circuits; 

a plurality of point-to-point connections be- 
tween the plurality of hub circuits to facilitate 
10 communication between the plurality of hub cir- 

cuits; and 

Wherein the plurality point-to-point connections 
are made using at least some of the plurality of 
traces. 

IS 

6. The system of claim 5 wherein the plurality of point- 
to-point connections comprise bi-directional serial 
links, 

20 7. The system of claim 5 wherein each hub circuit of 
the plurality of hub circuits has a first point-to-point 
connection to a first adjacent hub circuit and a sec- 
ond point-to-point connection to a second adjacent 
. hub circuit. 

25 

a. The system of claim 5 wherein at least one circuit 
pack of the plurality of circuit packs includes a con- 
trol/routing circuit that Implements a protocol for 
communication between the plurality of hub circuits. 

30 

9. The system of claim 5 wherein two circuit packs of 
the plurality of circuit packs are designated as cen- 
tral circuit packs and each hub circuit of the plurality 
of hub circuits that is not on the central circuit packs 

35 has a point-to-point connection to each of the cen- 
tral circuit packs. 

10. An electronic system comprising: 

40 a backplane including a multi-layer circuit 

board with a plurality of traces and a plurality of 
slots for coupling to the plurality of traces; 
a plurality of circuit packs coupled to the plural- 
ity of slots such that one circuit pack of the plu- 

45 rality of circuit packs Is coupled, to one slot of 

the plurality of slots; 

Wherein each circuit pack of the plurality of cir- 
cuit packs includes a hub circuit to provide a 
plurality of hub circuits; 

50 Wherein each hub circuit of the plurality of hub 

circuits communicates with another hub circuit 
of the plurality of hub circuits via a direct point- 
to-point connection between the each hub cir- 
cuit and the another hub circuit or the each hub 

ss circuit communicates v/lth the another hub cir- 

cuit via at least one hub circuit of the plurality 
of hub circuits and at least two point-to-point 
connections; and 
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wherein the direct point-to-point connection 
and the at least two point-to-point connections 
are nriade using at least some of the plurality of 
traces. 

1 1 . The system of claim 1 0 wherein tha direct point-to- 
point connection and tho at Jeast two point-to-point 
connections comprise bi-directional serial links. 

12. Tha system of claim 10 wherein each circuit pacl< 
of the plurality of circuit packs includes a control/ 
routing circuit that Implements a protocol for com- 
muniCQtlon between the plurality of hub circuits. 

13- ThQ system of any of claims 4,8 or 12 wherein the 
or each said circuit pack including a said control/ 
routing circuit further comprises an application cir- 
cuit coupled to the control/routing circuit. 

14. The system of claim 13 wherein the application cir- 
cuit comprises at least ono of an access Interface; 
lins interface, trunk Interface, processing resource 
and digital signal processor. 

15. The system of claim 13 wherein the application cir- 
cuit Includes a connectorfor receiving a module cir- 
cuit. 

16. An electronic system comprising: 



10 

that some extended traces of the plurality of 
traces of the first backplane are connected to 
some extended traces of the plurality of traces 
of the second backplane. 

17. The system of claim 16 wherein the first extender 
drcuit pack is coupled to the second extender circuit 
pack via a cable. 



IS 
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a first backplane and a second backplane, each 
of the first backplano and second backplane in- 
cluding a multi-layer circuit board with a plural- 
ity of tracGs and a plurality of slots for coupling 
to the plurality of traces; ss 
a plurality of circuit packs coupled to the plural- 
ity of slots such that one circuit pack of the plu- 
rality of circuit pacts Is coupled to one slot of 
the plurality of slots; 

wherein each circuit pack of the plurality of cir- 
cuit packs includes a hub circuit to provide a 
plurality of hub circuits; 

a plurality of point-to-point connections be- 
tween the plurality of hub circuits to facilitate 
communication between The plurality of hub cir- 45 
cuits; 

wherein the plurality point-to-point connections 
are made using at least some of the plurality of 
traces; 

a fir^t extender circuit pack: coupled to the first so 
backplane to extend some extended traces of 
the plurality of traces of the first backplane; 
a second extender circuit pack coupled to the 
second backplane to extend some extended 
traces of the plurality of traces of the second ss 
backplane; and 

wherein the first extender circuit pack and the 
second extender circuit pack are coupled such 
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FIG. 2 
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FIG. 3 
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